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OPERANT REINFORCEMENT OF A MEDIATED AUICKQKIC RESPONSE 
Background : ; 

Kowrer and some other psychologists have argued that there are two 

\ 

distinct methods of conditioning or learning (roughly, classical con- 
ditioning and instrumental learning). Furthermore they have insisted 
that instrumental learning cannot be reduced to classical conditioning, 
and that classical conditioning cannot be explained by the laws of 
instrumental learning. A3 evidence, Kowrer points to the fact that 
autonomic responses and skeletal responses are qualitatively different 
as they are given in nature. "Here we are assuming that behavioral 
responses are categorically different from emotional responses: the 

former are 'voluntary' and subject to influence through reward and 
punishment (and not conditionabie, strictly speaking), whereas the 
latter are involuntary and conditionabie and not subject to control 
through reward and punishment, or at least not in the same way as are 
the overt behavioral responses." (itowrer, i960.) 

There are everyday instances cf apparent learning of an autonomic 

response through reward; Skinner cites the child who cried "real tears" 

* 

because tears had been followed by attention and candy in the pa 3 t, and 

\ 

recently same experimental evidence . jhas shown that 

autonomic responses can be directly modified by response contingent 
reinforcement. However, it is not possible to rule out the effect of 
skeletal mediating responses in ary of these cases. If the autonomic 
response in question is elicited t>y an unobserved skeletal response, it 
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is possible that all of the evidence for apparent autonomic learning 
merely reflects the parasitic reinforcement of the underlying skeletal 
response. 

p 

Some authors (Kendier, 1962) have insisted that even the possibility 
of skeletal mediators is sufficient to reject the hypotnesia of autonomic 
learning through direct reinforcement. 

2toe mediation explanation asserts that the mediator is c skeletal 
response which precedes and elicits the autonomic response. As a result 
of rewarding the autonomic response, the skeletal response is parasitically 
reinforced and learned. Ifcus it is implied that a typical negatively 
accelerated learning curve would develop for the skeletal response. It 
is also implied that the variability in the autonomic response can be 

fully explained by the changes in the frequency of the underlying skeletal 
response. 

In the present experiment, it i3 proposed to 3 et up an explicit medi- 
ating skeletal response which elicits a drop in galvanic skin resistance, 
and then reinforce the elicited sutonccic response. 

If the mediation explanation is correct, it should be possible to 
discover both the negatively accelerated curve', of the skeletal response 
and to explain the variability of the elicited autonomic response. It 
may also be possible to compare these findings with the results of the 
earlier studies where an autonomic response was apparently directly 
reinforced. If the learning curves are very similar, it would suggest 
that an unknown skeletal mediator was responsible for the changes 
observed in the earlier work. 
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It is possible thet results from this study will give us some 
of model of operant learning of autonciaic responses as it occurs in 
stressful situations. 

Method : 

The method will be a fairly direct extension of methodology used in 
e£r ^ er studies /college age female volunteers will be 

t 

used; this will permit a reasonable comparison with the old data. Ten 
experimental and 10 control subjects will be run, they will be matched 
for frequency of GSR nonspecific deflections on the first day of the 
experiment and yoked for schedules of reinforcement for the remainder of 
the experiment. 

In the earlier studies it was observed that very large respirations 
occurred intermittently in what was otherwise a very regular respiration 
rate. These large respirations were often followed by a GSR deflection. 
For example, on the last day of the 1963 experiment, the eighteen subjects 
emitted 0 to 26 gross irregularities of respirations during the twenty 
minute session with an average of 7 per subject. Tnese respirations 
often elicited GSR deflections. Ti.e rate of GSR elicitation varied from 

it 

12^ for one of the subjects to 100>; for four of the subjects; the median 
'fos 'jO'/jt *n that experiment a special effort was made to avoid reinforcing 
respiration-elicited GcR deflections • in the present study, it is pro- 
posed that these gross irregularities cf respiration be utilized ns 
skeletal mediators; and that their associated GSR deflections be systemati- 
cally reinforces. This response lies the advantage cf being relatively 


subtle an d not immediately discernible to the subject. 

It is suggested that the responses be monitored by the experimenter t 
at this point. It would probably be too complicated to set up an 
automatic reinforcer for what should be e relatively short, contained 

study. 

Otherwise, methodology will follow the earlier studies. All subjects 
will be given 2 days of adaptation, five days of reinforcement (contingent 
or yoked) and three days of extinction. We will follow the policy of 
" having the subjects sit quietly for twenty-five minutes before each day’s 
session of twenty ninutes. All girls will be screened for medical 
problems and run in between menstrual periods. The experiment should 
be conducted in a sound-proof constant temperature rocra. 


Equipment; 


Sanborn 


GSR with Wenger electrodes, plethysmograph (Kenelco Corp.) 


pneumemoseter * 


Data Analysis; 

■ ■ ■ 111 " 1 " 

• • * . . 

• < v. - 

Do you think we can get direct taping of the output of ell three 
variables? In G3H, all we need is a frequency count— amplitude of the 
deflections does not seem, to be Import .int. liiat should simplify the 
problem, too. However, minute by minute basal resistance counts should 
be obtained. The fact that basal resistance shifts over the twenty 
minute period may present special difficulties. On the plethysmograph 
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record, I'd like to take off heart rate (in twenty aeoond intervals) and 

amplitude (about once every twenty seconds). The respiration record may 

/ 

be the most difficult to automate, if our experience in recording by 
hand is any indicator. I have ample samples of ell these, plus e fairly 
specific outline of how they were counted by hand. 

Once the data are in digital form, we will need individual and group 
curves on all ..three variables. la the past I have U3ed some rather 
simple nonparametric statistics for looking at differences. It ia quite 
clear that the major variable will be on intra- individual change from 
adaptation (days 1 and 2) to extinction (days 9 and 10). It has been 
suggested to me that there is same way of looking at clusters of ell 
three variables at once as a measure of learning (Hoseling's *)« However, 
I am not sure that with this 3»ali sample, non-normal data, etc., that 
that is feasible. Any suggestions? 

It seems to me that at this early stage of experimenting, the auto- 
mation of p-tT these things should be kept simple— to leave roan for 
changes in procedure and to maintain quite a bit of flexibility in the 
Bystem. We are handicapped by the fact that our background knowledge of 
ongoing basal rates and indivldusj. differences in GSR noaspecific3, 
plethysaograph amplitudes, etc. is still quite limited. 

Data Parameters : 

1. Basal Resistance 

In general, all subjects show an increase in bu3til resistance from 
day one to ten in this kind of stu-y. The controls tend to show a 
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relatively greater increase than the experimental subjects. 

There are side individual differences in basal resistance. In my 
1964 3 tudy, I found that it varied froa 61.9 K (MT, day 1) to 444.6 K 
(MH, day 5)» 

Within an individual, a maximum change of about 150-200 K could be 
seen from day one of the experiment to day ten. Median readings for 
each day were used as estimates of each subject's daily level. 

Basal resistance can show rather marked change within a daily session 
for seme individuals. In the 1964 study, at leant one subject had an 
increase of over- 200 K from beginning to end of the twenty minute session 
on day 9 (CJ) • Other subjects tend to remain quite stable within a day's 
run and from day to day. 

In general, subjects with low basal resistance put out a high fre- 
quency of nonspecifics, while subjects with high basal resistance proauce 
few nonspecifics. For instance, in the 1964 study, one subject (MT) had 
or. initial basal resistance of only 6i K and her output of nonspecifics 
wos over 6 per minute. Another subject with a high basal resistance 
(33I K) had a nonspecific rate of .4 per minute? 

■*. 

2. lionspecifics 

In the 1964 study, experimentals tended to maintain their initial rate 
of nonspecifics while controls declined. 

There are large individual differences in frequency cf nonspecif icc . 

In the 1964 study, the lowest reading on dey 1 was .4 per minute, the 
high was over 6 per minute. Both experimentals and controls show some 
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decline in rate over the ten day3, so the range on day 10 is .05 per 
minute to about 5 per minute. 

I do not have any current data on amplitude of deflections. The 
smallest we counted was .4 K and the largest was ?0 Z., but there were 
unquestionably larger ones. Data from the 1962 study suggests that size 
tends to increase as basal resistance increases frccn day one to day ten; 
median amplitude Increased as much as three times the day one amplitude 
(conductance readings). 

3. Heart Rate 

In the 1964 study, experiment als maintained their initial level of 
heart rate while controls showed a small but consistent decline. 

Again, there are fairly large individual differences. In the 1964 
study, the eighteen subjects ranged frcra 61.8 to 104.7 with a standard 
deviation of 12.8. 

Under non-strescful repeated trials, the standard deviation within 
an individual is about 6 beats per minute. She new r-timim within individual 
variation that we saw over days was 15 beats per minute. 

4. Plethysaograph ■* 

Tills data is purely ranked data. On the first day of the 1954 study 
we found that subjects varied from a minlmri amplitude reading to twice 
that reading. Over the ten day session, controls tended to increase in 
amplitude while experimented reraein relatively constant. Some subjects 
doubled their amplitude over the ten days, while at least one subject 
showed a reading which was half a.; large as his initial amplitude. 



